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Abstract 

This paper describes GUIDON- WATCH, a graphic interface that uses multiple windows and 
a mouse to allow a student to browse a knowledge base and view reasoning processes during 
diagnostic problem solving. Methods are presenteu for providing multiple views of hierarchical 
structures, overlaying results of a search process on top of static structures to make the strategy 
visible, td graphically expressing evidence relations between findings and hypotheses. This 
work demonstrates the advantages of stating a diagnostic search procedure in a well-structured, 
rule-based language, separate from domain knowledge. A number of issues in software design 
are also considered, including the automatic management of a multiple-window display. 
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1. Introduction 

An increasing number of Artificial Intelligence (AI) programs are implemented on high 
performance workstations with a bitmap display, a mouse, and a keyboard. The programming 
environment (usually a dialect of US?) generally provides support for displaying multiple 
windows and using menus that can be selected with a mouse. Importantly, a programmer can 
also specify arbitrary regions of a window (e.g.. text items) to be selectable with the mouse. 
This means that a user can invoke an action by pressing or releasing a mous^. button while the 
mouse cursor is in a selectable region. These features make it possi^jio to create a user 
interface that is efficient and easy to use for viewing and browsing a complex system. 

The GUIDON project at Stanford University is investigating how knowledge-based systems 
can provide the basis for teaching programs. NEOMYCIN (Clancey and Lctsinger, 1984). a 
medical consultation system, has been developed for this purpose. This paper describes 
GUIDON-WATCH, a graphic interface to NEOMYCIN that uses multiple windows and the 
mouse to allow a user to browse the NEOMYCIN knowledge base and view reasoning processes 
during a consultation. The results reported include methods for providing multiple views of a 
daia base, techniques for illustrating dynamic processes including a search strategy, and some 
conclusions regarding automatic ruanagement of a multiple window display. 

The paper is organized into the following sections: 

• Project Goals and Results to D^ie 

• The Development of NEOMCYIN 

• Description of GUIDON-WATCH 

• Prior and Related Work In Graphic Interfaces 

• Future Work 

• Conclusions 

2. PiToject Goals 

The ability to display and select information in several windows allows people to control and 
observe the behavior of an application program more easily. A graphic interface to a 
knowledge-based system can serve different kinds of users, including system designers, 
implementers. domain experts, students, and other end users. 

In the GUIDON project, the end users will be medical students. We are currently 
collaborating with physicians and medical students to adapt NEOMYCIN. GUIDON-WATCH, 
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and other programs for medical instruction. However, when this work began better tools were 
also needed to maintain the NEOMYCIN knowledge base and lo debug program behavior. As 
a result. GUIDON-WATCH evolved into a tool for both programmers and medical students to 
use. We are just starting to make a clean separation between ihe functionality that is useful 
for students versus programmers. We plan to develop user profiles that determine the interface 
behavior in a given situation. The current prototype can only be customized by making 
changes at the programming level. 

GUIDON-WATCH is ba^ed on established principles for designing user interfaces on 
graphical workstations (Ingalls. 1981. Tesler. 1981. Foley and Van Dam. 1982, Card, et al.. 1983. 
Foley, et al.. 1984). The design criteria for GUIDON-WATC^I emerged from the conventional 
wisdom on the subject. The user interface is viewed as a conversation consisting of two 
languages (Foley, et al.. 1984): (1) the language in which the user retrieves or requests 
inforiTiacion (with the mouse), and (2) the program's display and its interpretation. With 
regard to both languages we aim to maximize expressiveness, understandability. and efficiency. 
The user should be able to retrieve all information through one interface that is easy to 
understand and efficient to use. The display should include all relevant information, be easy 
to interpret, and update quickly when a user makes a request. 

Several GUIDON-WATCH users have found the interface simple, consistent, and easy to use. 
However, those unfamiliar with NEOMYCIN have difficulty realizing exactly how and when 
the display can be useful. We have found that the display is the best means we have for 
explaining NEOMYCIN. Therefore, an on-line introduction to GUIDON-WATCH and 
NEOMYCIN is planned. 

Informal evaluation with Stanford University medical students is schedulev^ for the fall of 
1985. Students will watch NEOMYCIN diagnose one or more patients. Data records of actual 
patients will be stored in files that can be accessed by NEOMYCIN during its questioning 
phase. A student will use GUIDON-WATCH to observe NEOMYCIN'S reasoning processes 
during the consultation. NEOMYCIN will be able to explain in English why it asked a 
question (Hasling. 1984). Eventually, students will assist NEOMYCIN during a diagnosis in an 
apprenticeship setting. 

The major results to date are summarized below: 
• Multi:»le windows can provide several concurrent views of a knowleage-based 
jystem. They help users cope with the complexity of the system by highlighting 
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and summarizing i.nportant reasoning events during a problem-solving session. 

• Several methods for highlighting facts and events were found effective. These 
include using different font styles, reverse video, boxinj^ flashing, and graying 
regions. Using these techniques, dynamic information associated with a given 
patient can be overlaid on top of static structures such as a disorder tree or a table 
of evidence. 

• Early results indicate that both programmers and medical users prefer to have 
GUIDON-WATCH manage screen space automatically. This includes th<* sizing, 
placing, and closing of windows. It is not trivial to do this with a large number of 
windows, particularly during development when changes to the system are frequent. 
A knowledge- based approach to window management is suggested. 

3. The Development of NEOMYCIN 

The GUIDON project evolved from the MYCIN experiments (Shortliffe, 1976, Buchanan and 
Shortliffe, 1984) of the 1970s. MYCIN is a rule-based consultation program that recommends 
drug therapy for certain infectious diseases (e.g., meningitis). Because much of the 
functionality (e.g., the inference mechanism) of MYCIN does not depend on medical 
knowledge, it was possible to develop a domain-independent shell called EMYCIN (Van Melle, 
1981). MYCIN now consists of EMYCIN plus the MYCIN medical knowledge base. EMYCIN 
was used to develop several other knowledge-based systems, and is the basis for several 
commercial products. 

In 1979 Clancey completed GUIDON (Clancey, 1983), an intelligent tuturing system that 
interfaces with EMYCIN. GUIDON can interactively present the rules in an EMYCIN 
.nowledge base to a student. However, Clancey found that the MYCIN rules were often 
difficult to understand because they combine a diagnostic procedure with medical facts in an 
opaque manner (Clancey and Letsinger, 1984). In a MYCIN rule the ordering of conjunct 
clauses in the premise might implicitly contain a strategy. For example, a rule might only 
apply if the patient is an alcoholic. One MYCIN rule premise begins with "if the patient is 
over 18 years of age and an alcoholic." The strategy that is implicitly represented in this rule 
premise is "dcn't ask a patient under 18 years of age if they are alcoholic." As a result, 
students would not understand many MYCIN rules nor the diagnostic strategy that MYCIN uses 
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NEOMYCIN ►HERACLES ►GUID0N2 



j^YClN ► EMYCIN ►GUIDON 

Figure 3-1: The evolution of a knowledge- based system 

MYCIN evolved into EMYCIN, a domain-independent skell for building 
k owledge-based iystems. The GUIDON tutoring system is a separate module that 
could be used nth any EMYCIN system. EAfYCIN was not found to be an 
adequate found ;t ion for an instructional program. Therefore, EMYCIN and the 
MYCIN knowlelge base were reconfigured into NEOMYCIN, a medical consultation 
system which /a designei for enhanced explanation and tutoring capabilities. The 
domain-independent shell that NEOMYCIN is built with is called HERACLES. 
NEOMYCIN is the basis for GUID0N2, a tutoring system now In development. 

implicitly. 

GUIDON demonstrated that satisfying the requirements for expert performance are not 
necessarily sufficient for the purpose of explanation and tutoring. Therefore, MYCIN was 
significantly reconfigured into a new program called NEOMYCIN (Clancey and Letsinger, 
1984) ihM represents a diagnostic strategy separately from medical facts. For example, the 
diagnostic strategy used in NEOMYCIN explicitly states to check for conditions that would 
make a question inappropriate. The knowledge base has also been expanded to include diseases 
that can be confused with meningitis (this is important for instruction). NEOfwfYClN is the 
foundation for GUIDON-2, a new series of instructional programs. GUIDON- WATCH is the 
first component of the GUIDON-2 system. Importantly, interactive graphics makes knowledge 
and reasoning visible only to the extent that the knowledge is represented explicitly in a 
program. The well-structured and explicit design of NEOMYCIN provides many opportunities 
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for exposing the program's reasoning to students and other users. 




Figure 3-2: The HER\CLES architecture. 

The relationship between GUIDON-WATCH and three primary syster^x modules Is 
illustrated above. A consultation system consists of HERACLES, a knowledge base, 
and GUIDON-WATCH. For instructional use, the GUID0N2 module (now in 
development) can be added. GUIDON-WATCH provides an interface for 
instructional use, to run consultations, and to edit the knowledge base. Although 
there are differences in the interface for each kind of user, in general, the 
interface is very similar and represents a single program with several modes of 
behavior. (The graphic editor is not described in this paper because that interface 
has not been completey integrated with HERACLES.) 



NEOMYCIN has ^ed to a domain-independent system called HERACLES. HERACLES is to 
NEOMYCIN as EMYCIN is to MYCIN (Figure 3-1). In other words. NEOMYCIN consists of 
HERACLES and a medical knowledge base (Figure 3-2). HERACLES is a software tool 
applicable to diagnostic problems in many domains. For example, HERACLES was used ;o 
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develop a knowledge base for cast iron fault diagnosis (Thompson and Clancey, 1985). The 
HERACLES program includes a diagnostic procedure represented in a rule-based declarative 
language, rule interpreters, a set of domain relations (e.g.. causes, subtype, suggests), various 
software tools for developing knowledge-based systems (many derived from EMYCIN). an 
explanation facility, and GUIDON-WATCH. To construct a specific consultation program, the 
system designer adds a knowledge base of facts anu rules. All the examples in this paper use 
the NEOMYCIN knowledge base, but GUIDON-WATCH will work with any HERACLES 
knowledge base. 

4. Description of the GUIDON-WATCH display 

The windows and menus used in GUIDON-WATCH rje described in detPil in this section. 
First, the programming environment is briefly described to show what lools we started with. 
Second, an overview of the interface is provided. The third section describes tne display 
facilities in detail. 

4,L Programming Environment 

GUIDON-WATCH is implc;mented on XEROX 1100 Series workstations running 
INTERLISP-D. The black and white display screen is 1024 pixels wide by 808 pixels high, 
which provides approximately 75 pixels per inch resolution. INTERLISP-D provides a window 
package that support, multiple overlapping windows, scroll bars, and other window 
operations (Sannella. 1983). Many graphics primitives are provided for drawing lines and 
curves, manipulating bitmaps, filling and manipulating regions, checking the state and position 
of the mouse, etc. In addition, a menu package, a grapher package (e.g.. to displa> trees), and 
several default window functions (e.g.. scrolling by repainting) are provided. It required only a 
page of code to implement a simple pull-down menu package using the window primitives. 

4.2. Overview of the User Interface 

Pull-down menus and a Prompt Window are at the top of the GUIDON-WATCH display. 
(Figure 4-1). The Prompt Window is a standard part of the INTERLISP-D user interface and 
is used to print messages. Currently there are three pull-down menus of interest to a medical 
student: KB (Knowledge Base) Windows. Consult, and Help. The KB Windows pull-down 
menu displays a Asi of windows that can be opened for browsing the knowledge base or 
viewing a consultation. The Consult menu is used to start and quU a consultation. The Help 
menu allows the user to obtain information on the contents of a window. 
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Figure 4-1: A GUIDON-WATCH display during a consultation. 

,Jr\!!r T"'"^ °, ''"""''''f'''" ^nrf "^e system has paused a, question 5. The 
user has opened several windows to get information about the hypotheses that are 

Jjl^/Z^c'f 'f''^'^i^''i''«^r-7^^ '^ P"" ^0^" ntenus lLZ iSrJted- the 
TaL^ZJ^ rffj''' Windows menu and moved the mouse over the menu item 
be disp7ayed " """" Taxonomy Window will 
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4.2.I. Use of the mouse 

XEROX 1100 computers can be 'istd with either a two or three button mouse (selecting the 
left and right button at the same time on a two button mouse is equivalent to pressing the 
middle button on the three button mouse). In GUIDON-WATCH, the mouse is used in ? 
simple and consistent way. The left button is used to select all menu items and text items in a 
window. For example, in a window that displays a list of diseases, the user can select the 
name of a disease using the left button. A pop-up menu is displayed that allows a user to get 
more ir formation in another window (Figure 4-2). Only those items that are cu/rently relevant 
appear in the pop-up menu. 




Figure 4-2: The Causal Relations Window. 

The user has selected the node SUBARACHNOID-HEMORRHAGE with the left 
button and a pop-up menu is displayed with Items for displaying additional 
Information. This graph was automatlc^^h generated from the NEOMYCIN 
knowledge base, ' Ited by hand to fi* at ^^reen, and then stored on a file. If 
the user wished to display the graph v /ferent root node GUIDON-WATCH 

dynai ucaliy generates the graph at rum 



It has not been decided whether or not students will be asked to use more than the left 
button. In our current programming environment, the right button is used in the default 
manner provided by INTERLISP-D, to manipulate windows (e.g., reshaping, closing). The 
middle button is sometimes used to display a pop up menu with items that apply to the entire 
data structure in a window. For example, a user may want to highlight those items in a 
window that all have a certain property. We are considering the. use of icons in a window for 
operations besides selecting menu or text items (e.g., closing a window). 1 ^refore, the student 
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interface may only use one button. 
4.2.2. On-line Help 

If the user selects Help window from the HELP pull-down menu, then a HELP icon attaches 
to the mouse cursor. The user can get help about a window by moving the HELP icon into a 
window and buttoning the window. A message associated with the selected window is printed 
in a special help window. 

Management of windows 
The INTERLISP-D graphics package provides functions for prompting users to position a 
ghost image of a window or to a shape a window. These prompts can be confusing to novices 
and distract from the task at hand. If it is possible to maKe a good decision r-^garding the size 
and position of a window, then we can free the user from this chore. In addition, an 
automatic window management system can often optimize the use of screen space better than a 
user. This is true in GUIDON-WATCH because there are a known set of windows whose 
contents are constrained to a certain form (e.g., a table). 

To manage the window display, the screen is divided into logical units. The GUIDON- 
WATCH screen consists of a top, middle, and bottom section. The top section contains the 
pull-down menus and the Prompt Wincow. Tht bottom and middle sections display knowledge 
base structures and have well-defined lower borders. Another logical division of the GUIDON- 
WATCH display provides vertical boundaries. For example, the width of the screen can be 
divided into equal or unequal regions. The current prototype uses three regions with two equal 
and one slightly wider than the other two. Furthermore, you can have a hierarchy of 
subdivisions (i.e., regions) Each window in GUIDON- WATCH is associated with one or more 
regions where it can be displayed. 

GUIDON-WATCH decides where to place a window based on several considerations: (1) the 
default region of the window, (2) the other windows that are displayed and their position, and 
(3) the set of windows that the user would mostly likely prefer to remai in view. While the 
current window management system is effective, we would like to extend the flexibility of the 
interface. This would require a more complex scheme. It might be necessary to consider 
moving or reshaping windows that are already on the screen. Note that window systems that 
provide this capability do not consider the semantics of the contents of windows. Therefore, 
algorithms for scaling pictures and changing the font size of text are not sufficient when you 
have to decide where windows should be placed and which windows should be closed or 
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covered. 

Although flexibility and control are relinquished by the user, the benefits of automatic screen 
management seem to outweigh potential disadvantages. Automatic window management saves 
the user time and maximizes the use of screen space. It is possible to allow the user to turn 
oif automatic features, change defaults, or allow the user to use the move and reshape facilities. 
Furthermore, mckiU5 or icons can be used to allow the user to choose from a predefined set of 
sizes, positions, fonts, etc.. but fhen the ir?nlementation of the automatic window manager 
becomes increasingly complex. In our cunent implementation, when a window is displayed, a 
complex conditional in the window's dispLy function i: evaluated. This code is difficult to 
understand and modify. In addition, the situation has been complicated by the need for 
different user profiles. We are considering an approach where the behavior of the interface is 
specified separately and declaratively using knowledge representation formalisms (e^., rules) 
and object-oriented programming. 

4.2.4. Dynamic updating of the screen display 

Displaying dynamically changing information presents problems that are not unique to our 
application. For example, how often do you update the screen? Do you gray out regions that 
are out of date or immediately updat^^ them"^ Our philosophy is that users should ot able to 
open and close windows at any time and that the display should accurately reflect the current 
state of the system or gray out regions that are not continuously updated. Regions that are 
grayed out can either be automatically updated at specified intervals or manually updated by 
having the user simply button the window to redisplay itself. 

43. The GUIDON-WATCH windows 

This section describes many of the windows available to the GUIDON-WATCH user and 
addresses the following important issues: What information in a HERACLES knowledge base 
is most important to display? For programmers? For medical students? How can dynamic 
information be displayed? In the first subsection below, the focus is on static knowledge 
structures and how they are displayed in GUIDON-WATCH. Subsequent subsections discuss 
the display of dynamic consultation knowledge. 
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4.3.1. What is there to display in a knowledge base? 

A HERACLES knowledge base (e.g.. NEOMiCIN medical knowledge base) includes findings, 
hypotheses, rules, tasks, and relations among theses. Findings are data that can be requested or 
inferred from rules. Generally findings can be observed or measured. Hypotheses can only be 
inferred from rules. In NEOMYCIN, hypotheses include diseases and pathophysiological states. 
Relations refer to predicate calculus relations and in HERACLES include subtype, causes, etc. 
Static knowledge includes facts about findings and hypotheses as defined by relations (e.g.. 
meningitis is a subtype of infection, headache is a finding, etc.). It also includes the diagnostic 
procedure and domain rules (e.g., if the patient has double vision, then there is suggestive 
evidence for intr'^cranial pressure). Dynamic knowledge u situation specific and refers to 
information that becomes known only during a problem solving session (e.g., "Mary's 
temperature is 102 degrees."). 

NEOMYCIN uses a diagnostic strategy known as heuristic classification (Clancey and 
Letsinger. 1984). Given a i enumerated set of solutions (e.g., diseases or possible diagnoses). 
NEOMYCIN heuristically maps a set of findings onto one or more possible solutions. This 
diagnostic procedure is provided by HERACLES (Heuristic Classification Shell). It is 
represented as tasks, which are procedures that are stated in a declarative rule- based language 
(Figure 4-3). When a task is invoked, one or more of its metarules are applied (Figures 4-4. 
4-5). Metarules in HERACLES are similar to conditionals in a procedure, but they are 
expressed as abstract rules. 

Windows that display static knowledge include the task and metarule windows in Figures 4-3. 
4-4. and 4-5. They also include the Findings. Hypotheses, and Relations windows, which 
simply display an alphabetical ordering. Other windows display a graph to show the 
relationships between groups of objects. The Causal Relations Window (Figure 4-2) is a lattice 
with causal and subtype links between findings and hypotheses: the Diagnostic Strategy window 
(Figure 4-6) shows the calling structure of the diagnostic tasks; and the Taxonomy window 
(Figure 4-7) represents a subtype hierarchy of disorders. In all of these windows the user may 
select an item to get more information. 

4.3.2. Reifying the process 

The windows described below all display dynamic information during a consultation. 

The faxonomy and Causal Relations Windows. An important concept in medical diagnosis is 
the differential, the set of competing hypotheses currently being considered. The etiological 
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Figure 4-3: The Task Property Window. 
Above the properties and values of the task Pursue-Hypothesis are displayed. 

taxonomy is a tree of possible diagnoses or solutions in NEOMYCIN. The differential 
represents a cut through this solution space. Boxing the hypotheses in the Taxonomy Window 
that are on the differential is simple way to make this cut visible (Figure 4-7). 

Flashing and boxing nodes in the Taxonomy and Causal Relations Windows emphasize the 
dynamic search strategy. Whenever a hypothesis is added to the differential, its corresponding 
node label is flashed and then boxed. Whenever the hypothesis is removed from the 
differential, the box is redrawn with lighter lines, so that the hypotheses that had been 
considered previously are still highlighted, but the ones currently on the differential are more 
prominent (Figure 4-7). A student can observe NEOMYCIN looclng up the disorder tree to 
group end compare categories of disorders before looking down to refine hypotheses. 

Conclusions in a HERACLES consultation are associated with certainty factors that represent 
a degree of belief. They are not probabilities. In HERACLES, each hypothesis has both a 
certainty factor (CF) and a cumulative certainty factor (CUMCF). The CF represents the 



ERLC 



18 



14 



Metarules^or PUP.iUE-H-, potmE^ 



PURSUE-HYPOTHESIS 




RULE171 



RULE590 



TEST-HYPOTHESIS REFINE-NODE 



Figure 4-4: The Metarules Window. 



Above the metarules that the task Pursue-Hypothesis calls are displayed. 



combined certainty of all rules that have concluded directly about the hypothesis. The CUMCF 
represents a combination of the CF of a given hypothesis (which may be zero) with CPs of its 
descendants in :he disorder taxonomy. For e. ample. evidence for meningitis (a positive CF) 
increases the CUMCF of infectious process because meningitis is a subtype of infectious 
process. (To be exact, negative CFs of ancestors are also combined: therefore, evidence against 
infection can decrease the CUMCF of menfngitis.) 

When the CF or CUMCF is updated for a hypothesis, new values are printed below the node 
label corresponding to the hypothesis. The CF is printed on the left, the CUMCF on the right 
if it differs. The figures in this paper show the CFs printed as integers from -1000 to +1000: 
this is how they are represented internally. These numbers are far from precise and should be 
interpreted as falling in several categories: definite, strongly suggestive, suggestive, weakly 
suggestive or no evidence for (or against) a hypothesis. For students the internal CF values 
will not be printed: instead a graphic notation, such as zero to four pluses or minuses could be 
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Figure 4 5: The Rule Window displaying a metarule of the task 

Pursue-Hypoihesis. 



used to indicate the degree of belief. 

In the case ir which a hypothesis window is not open, the printing, boxing and flashing of 
nodes is not done immediately. However, whenever the Taxonomy or Causal Relations window 
is opened during a consultation, the window is updated so that all the hypotheses are 
appropriately boxed, and certainty factors are printed. Therefore, the user is free to open these 
windows at any time. Below we describe several other windows that display dynamic 
information. 

The Consul. Jtion Typescript. The Consult window (Figure 4-], is opened when a user starts a 
consultation using the Consult menu. This window displays the questions that are asked during 
a consultation. Each question is followed by a response that is either supplied by the user or 
is retrieved automatically from a patient data file. Before an answer is retrieved the program 
pauses. The user can then use the mouse to select items or open any windows. A menu is 
provided that allows a user to proceed one or more questions further, receive textual 
explanations, resize the consultation window, etc. 



ERIC 



2G 



16 




Figure 4-6: The Diagnostic Task Tree Window. 



When a task is selected in this window, a menu pops up that allows the user to 
display either the properties of the task in the Task Property window (Figure 4-3) 
or the metarules that a task applies in the Metarules window (Figure 4-4). During 
a consultation the user can also choose to see dynamic information about task calls. 
This is described in the section Dynamic Task Windows. 



Evidence Window. This window can be displayed without running a consultation. However, 
during a consultation dynamic information is overlaid onto static knowledge structures to show 
the current evidence relations between findings and hypotheses (Figure 4-8). All potential 
evidence for a hypothesis is displayed as a table in this window. The first column lists 
findings and hypotheses that suggest a hypothesis. The second column lists the rules that use 
these findings or hypotheses to conclude about the hypothesis. The third column shows the 
maximum CF in the rule's action, and the fourth column i>hows. if different, the minimum CF 
in the rule's action. 

During a consultation, additional information is provided to the user through the use of bold 
fonts and graying over regions. A finding with a positive value is printed in bold; a negative 
finding is grayed over. Analogously, rules that have succeeded are printed in bold; rules that 
have failed are grayed over. Findings and rules that appear in normal print have not been 
investigated yet. This srmple notation is an effective means of providing a great deal of 
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Figure 4-7: The Taxonomy Window. 



The boxing, flashing, and printing techniques used in this window maks the 
dynamic search strategy visible by displaying dynamic information on top of a static 
knowledge structure, in this case the etiological taxuftomy. The differential shown 
here is NEOMYCIN'S internal differential and may not correspond precisely to a 
physician's differential. The differential shown to a student may differ from 
NEOMYCIN'S internal list. This graph was generated, edited, and stored in the 
same manner as the graph in Figure 4-2. Note that Figures 4-7 through 
4''10 correspond to the same state of the consultation as displayed in figure 4-1. 



information in a concise and understandable manner. Furthermore, it illustrates how dynamic 
information can be displayed on top of static knowledge structures that are displayed in a table 
format 

Positive Findings Window. The Positive Findings Window (Figure 4- 10) displays all the 
findings that have a positive value (i.e., the value is "yes", a number, or svmbolic). Findings 
are printed in the first column, values in the second column, and CFs in the third (printed 
only if less than 1000). Findings are selectable, and whet: buttoned a pop-up menu is 
displayed. For example, a user may want to select a finding to find out which hypotheses the 
finding may suggest. 

In this window items are printed incrementally during a consultation. If the Positive 
Findings window is open, then new positive findings are printed in the window ls soon as they 
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Figure 4-8: The Evidence Window. 



The findings and hypotheses displayed In this window are ordered so that the 
ones that may be most suggestive (have the highest MAXCF) are on top. The user 
may have selected Meningitis In the Taxonomy Window because It Is on the 
differential with a positive CF, and then displayed this Evidence Window. The 
user may then display a rule that succeeded or failed In the Rule Window. For 
example, RULEf24 Is printed in bold In the Evidence Window above showing that 
the rule succeeded. This rule is then displayed In the Rule Window (Figure 4-9). 



are known, the window is closed, then the whole list of positive findings is printed whe. 
the window is opened. This feature provides flexibility for the user, who can open or close 
the window at any time during a consultation. 

Differential and Hypotheses With Evidence Windows. Hypotheses on the differential are 
boxed when they appear in certain windows. However, the differential is such an impoitant 
structure that a special window is provi^1ed for its display (Figure 4-11). However, not all 
hypotheses for which there is positive evidence are on the differential at a given time. Another 
important class of hypotheses are all those for which there is belief. This includes hypotheses 
for which there is direct evidence (i.e.. at least one rule concluded the hypothesis) and those 
for which there is belief when propagation is included (i.e.. the CUMCF is above a certain 
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Figure 4-9: The Rul^ Window displaying a domain rule. 



threshold). These are displayed in a separate window (Figure 4-12). 

In both the Differential and Hypotheses-With-Evidencc windows, hypotheses that have direct 
evidence supporting them are printed in bold. These windows also contain columns for CF 
and CUMCF values. As usual, the hypotheses arc selectable. These two windows, as well as the 
Taxonomy and the Causal relations windows, illustrate how GUIDON-WATCH provides 
multiple yiews of the same knowledge structures. 

Dynamic Task Windows. These windows provide users with dynamic views of the diagnostic 
strategy as it is instantiated during a consultation. This is a challenging presentation problem 
because the abstract nature of the diagnostic procedure as it is represented in the task and 
metarules is not nearly as intuitive to people as are disorder hierarchies, causal networks, 
domain rules, and lists of findings. Although the goal is to provide a view of NEOMYCIN'S 
reasoning that is understandable to medical students, the model of the diagnostic strategy is in 
the form of a complex procedure that is intimately tied to basic concepts of computing. For 
example, task calls are very similar to piocedure calls; a task may have a focus and local 
variables. A focus consists of one or more findings, hypotheses, or rules depending on the task. 
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Figure 4-10: The Positive Findings Window. 



For example, Test-Hypothesis may have meningitis as a focus in NEOMYCIN. Taslcs invoke 
other tasks in a chain, similar to procedure calls. 

The three windows described below each provide a different view of the dynamic diagnostic 
strategy by using three different graphic formats: a stack, a tree, and a table. Although it has 
not yet been decided how they will be adapted for instruction, they are already very useful for 
programmers trying to debug or understand NEOMYCIN'S behavior. Programmers can use 
these windows to find out exactly what NEOMYCIN is doing or has done at a detailed 
strategic level. Consistent with Model's (Model, 1' 79) recommendations, these windows provide 
monitoring and debugging tools at a level that corresponds to the program's design (e.g.. tasks 
and metarules). This is a great improvement over examining the low-le el LISP stack which 
reflects the strategy only in a very indirect way. 

Task Stack Window. This window displays the current stack of task calls, which is similar to 
a stack of procedure calls (Figure 4-13). The task calls are printed from in the oider that they 
were called, with the first task printed at the top of the window. If the task has a focus, then 
it is printed in square brackets after the task. The metarule that the task successfully applied is 
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Figure 4-11: The Differential Window. 

This is the differential several questions after the point shoym in Figure 4-L 
Subsequent figures all show windows as displayed at this later point. 

printed below the task. Metarules are attached to the task they invoke by a vertical line. 
Different font faces are used to distinguish tasks, metarules, and foci from one another. Every 
rule, finding, and hypothesis in the Task Stack Window is selectable so that the user can 
quickly get more detailed information on an item of interest. 

The Task Stack Window provides a view of the -urrent path through the diagnostic tree with 
metarules and foci instantiated. By examining the task stack, the user can understand the 
reason for the current strategy For example, the user may be interested in why a question is 
being asked. Students will be able to get textual explanations that should satisfy their needs 
(Figure 4-1), but programmers may want to examine the task stack to understand the 
computational reasons for a data request at the task and metarule level. By examining the task 
stack in Figure (4-13) the user can see that NEOMYCIN is testing the hypothesis 
Mycobacteiium-TB-Meningitis. As a result, a rule that was applied led to a series of calls to 
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Figure 4-12: The Hypotheses With Evidence Window. 



the task Findout The last call, with the focus "compromised," finally resulted in the question 
"Is Mary a compiomised-host?" which the user would see in the Consultation Typescript 
Window. 

Dynamic Task Tree Window. This window displays a graph tha*, shows 11 or part of the 
dynamic history of task calls (Figure 4-14). This allows a user to view the overall structure of 
the diagnostic strategy that NEOMYCIN is using during or at the eud of a consultation. This 
is useful because ihe static Diagnostic Task Tree Window (Figure 4-6) shows all possible paths 
in the task tree; this window shows only the paths that aie part of an actual diagnosis and 
reveals patterns of multiple calls of the same task. 

Task History Window. This window contains a table of all the invocations of any given task 
during the consultation (Figure 4-15). More or less, it provir!.. an alternate view (for a given 
task) of the ^nform^ition displayed in the Dynamic Task Tree Window. In the first column, 
ihe invocation number of the task is printed, with "1" meaning the first time the task was 
called. In the second column, the focus of the task call is printed; in the third column, the 
Hivtarule that invoked the task is orinted; and in the fourth column, the calling task is printed. 
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Figure 4-13: The Task Stack Window. 



As usual, rules, findings, hypotheses, and tasks are selectable. Additionally, the user can select 

an invocation number in order to display more information on the history of that task call, 

including a dynamic task tree with the chosen task invocation as the root or any metarule: that 
succeeded during the task call. 

Together, the three dynamic task windows provide a powerful aid for inspecting the current 
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Figure 4-14: The Dynamic Task Tree Window. 



The node labels of tasks in this tree are abbreviated, but the user can see the 
full name expanded when a node is selected. TH is short for Test-Hypothesis in 
this tree. The figure above illustrates how the us- : can see multiple calls of a 
task and the resulting events in the Dynamic Task Tree Window. 



and past diagnostic strategy used during the consultation. It is clear that medical students 
would need some instruction in these concepts before the dynamic task windows would be 
meaningful to them. Part of the problem is that many of the task names are not commonly 
used in medicine. It is oped that some of the problem can be alleviated by choosing names 
for the diagnostic ta.' that are more familiar to students. Additionally, some tasks may be 
hidden from a student's view because they involve computational details of interest to a 
programmer only. 

5. Prior and Related Work in Graphic Interfaces 

GUIDON-WATCH was influenced by a diverse collection of work stretching back to 
Var.nevar Bush's seminal article, in which a desk-sized, electronic information device called a 
"memex" was proposed (Bush. 1945). Doug Engelbart and his colleagues pioneered much of the 
early work on information handling systems and provided the basis for the user interfaces 
commv-.ily found on today's workstations (Engelbart. 1963. English and Engelbart. 1967. 
Engelbart, 1970, Engelbart, 198?). Alan Kay led the Learning Research Group (LRG) at 
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Figure 4-15: The Task History Window. 



XEROX PARC that brought similar ideas to fruition on personal workstations. (Kay, 1977) 
Engelbart's group and the LRG shaped a view of the computer as a communications medium 
by which a user can storo, i'etrieve, miinipulate, and transfer information with case. The LRG's 
vision of a dynabook (Goldberg, 1979, Borning, 1979, Weyer and Borning, 1984, Gould and 
Finzer, 1984) stills remains an exciting dream in the spirit of Bush's memex. 

The 1970s also brought many advances in Artificial Intelligence including the development of 
knowledge-based systems such as MYCIN. Starting from a different point of view, Seymour 
Papert led a group at M.I.T. that explored the use of computer languages such as LOGO to 
teach subjects such as geometry and physics in a new way (Papert, 1980). Papert offers a 
provocative view of AI and computers in education; he influenced us to consider how we can 
provide students with conceptual and softvvare tools to explore computational models (Papert, 
1980). John Seely Brown further inspired us to understand the potential of these ideas; his 
discussion of reifying the process of problem solving (Brown, 1983) is particularly relevant to 
GUIDON-WATCH. To reify means to make real or concrete, or to materialize somfthing that 
is abstract. GUIDON- WA'T'CH makes the abstract diagnostic procedure used in NEOMYCIN 
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more concrete and visible. 

Partly because bit-mapped raster displays have only recently been integrated with AI 
programming environments, little has been written about graphic interfaces in AI programs. 
Some notable exceptions include Model (Model, 1979), AIPS (Zdybel, et al., 1981), the 
ONCOCIN project (Tsuji and Shortliffe. 1983. Tsuji and Shortliffe. 1985, Une. et al.. 1985). 
and the STEAMER project (Hollan. et al.. 1984. Stevens, et al.. 1983). Model demonstrated that 
graphic displays can facilitate the monitoring and debugging of complex programs (he used 
M\CIN for an early demonstration of his work). Tsuji and ShorUiffe investigated this idea 
further by implementing several graphic tools for constructing, monitoring, and debugging 
ONCOCIN's knowledge base and inference procedures. (ONCOCIN is a system that helps 
physicians administer experimental cancer therapy.) The ONCOCIN group's strong 
commitment to the use of interactive graphics has resulted in several graphic interfaces, 
including the ONCOCIN Interviewer (Une, et al.. 1985), a program that helps physicians enter 
patient data. 

STEAMER, an instructional program about power plant operation, uses interactive color 
graphics in a knowledge-based simulation. It is interesting to compare the use of interactive 
graphics in STEAMER and GUIDON-WATCH. STEAMER emphasizes the construction of a 
visible, interactive, and inspectable simulation. It displays the complex physical processes of a 
steam propulsion plant NEOMYCIN, on the other hand, is a computational model of 
diagnostic reasoning. GUIDON-WATCH provides a user with a visible, interactive, and 
inspectable model of NEOMYCIN'S reasoning processes. 

Several knowledge-base browsers similar to GUIDON -WATCH were developed more or less 
concurrently. For example. ART, KEE, SRL+. LOOPS, S.l, and STROBE provide interactive 
graphic displays that allow programmers to browse class hierarchies and other general data 
structures (Stefik, et al. , 1983. Kunz, et al.. 84. Williams. 1984, Richer, 1985). Sophisticated 
graphic editors may be provided; for example. STROBE has an excellent knowledge base 
editor (Schoen and Smith, 1983). However, the browsers provided in these systems are very 
general and are too complex for end users, requiring an understanding of the underlying 
knowledge representation framework. On the other hand, KEE and LOOPS do provide support 
for creating end-user iconic displays. These can be very useful for displaying the state of a 
complex device. 

GUIDON-WATCH differs from other browsing programs because it is tuned to display 
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specific kinds of knowledge structures (&g.. those found in a HERACLES system). For 
example. GUIDON-WATCH can display disease taxonomies, causal networks, evidence for a 
hypothesis, and positive findings in a way that is impropriate for end users such as medical 
students. Graphic techniques described in this papw illustrate an abstract diagnostic procedure 
during its actual use. To paraphrase, if a knowledge base is written for HERACLES, then an 
effective user interface is provided automatically. 

6. Future Work 

A continuing decrease in the price of hardware will provide more opportunities to use higher 
resolution screens, interactive pictiu^s, color, animation, and interactive video. Certainly, we 
have only touched the surface in using graphics for viewing a knowledge-based system. 
Interactive and animated pictures can illustrate facts and processes. However, implementing 
interactive graphic displays is timfc-consuming. There is a need for high-level user interface 
kits that provide most of the common features that developers now have to implement over 
and over again. It is probable that an object-oriented programming system wili be adopted as 
an extension to the Common Lisp standard (Bobrow. et »1. . 1985. Steele. 1984). This could 
provide the basis for a generic interface shell for lisp environments. Two examples of 
interface packages that successfully use the obi'-ct-oriented approach include MacApp (Tesler, 
.1985) and EzWin (Li«berman. 1985); the latter is written in flavors, the object-oriented 
language \vithin Zetalisp (Weinreb and Moon. 1981). 

The discussion so far has focused on what interactive graphics can provide for AI systems. 
However, AI technology can contribute directly to more intelligent graphic interfaces. Current 
research topics include user modeling, intelligent presentation, and declarative languages for 
describing graphical interaction. Mackinlay (Mackinlay. 1983) is investigating some of these 
issues. For GUIDON-WATCH, wc decided how to present information and hand-coded it 
Instead. Mackinlay's program reasons on its own about how to present information. For 
example, it can decide to present data as a bar chart, a pie chart, a plot chart, a table, or a 
graph. It can also design several alternative sophisticated presentations from simpler ones and 
then use heuristics to choose one to display to the user. 

Another important aspect of Mackinlay's work is that it uses a knowledge-based approach. 
Therefore, its reasoning is lopresented in an explicit, declarative langw^e and not in opaque 
code. The use of a declarative representation results in programs that are easier to modify and 
uw.:erstand. We found that the parts of our display codo that are trying to be smart, such as 
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the management of windows, are poorly represented in LISP. The code fails to make the 
underlying reasoning explicit, and it is difficult to modify. Another advantage of using a 
declarative representation is that it can be used in multiple vays. Mackinlay's current work 
addresses only the intelligent presentation problem, but eventually programs may be able to 
explain why a particular presentation was chosen. The graphic designer using an intekiigent 
computer aid would want a justification for some design decisions. In intelligent tutoring 
systems, it would be useful if a program could automatically generate questions regarding a 
presentation on the screen. 

The problems involved in developing intelligent interfaces are ceitainly very difficult, but if 
they are going to be solved, it seems likely that user interface behavior must be represented 
separately in a declarative language or a data base* Because the user interface is becoming an 
increasingly complex and important component of a software system, there a compelling 
reasons to make a clean separation between the user interface and the rest of a software 
system (Zdybel, et al., 1981, Smith, et al., 1984, Ciccarelli, 1984). There are several rcaicns to 
support such highly modular systems: 

• they are easier to maintain and debug 

• they can be customized more easily 

• domain independence is possible 

• an intelligent reasoning component can be interfaced with less difficulty 

In general, programs can be more attuned to individual users. Some users may prefer 
different configurations of the screen. The size of the fonts chosen in a window may be too 
small for some users. Optimizing screen space must not interfere with other concerns such as 
readability of the screen. Future versions of GUIDON-WATCH should allow users to 
customize the display to their liking while still providing automatic window management 
facilities. User models can play a role in smart interfaces that infer a user's preferences. 
However, a program must have an explicit model of the user in order to reason about the 
user's preferences. We beheve that a knowledge-based approach (i.e., using declarative 
representations) is necessary if a intelligent interface must combine general knowledge about 
presentation with specific knowledge about a user. This is an area for long-term 
interdisciplinary research in several areas of computer science, psychology, linguistics, 
communications, education, and graphic design. 
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1. Conclusions 

GUIDON-WATCH allows a user to view a knowledge-based consultation system efficiently. 
The program demonstrates how multiple windows, menus, and a mouse can be used to achieve 
this goal. It also demonstrates that stating a diagnostic procedure in a well'-structured rule- 
based language facilitates developing a graphic interface for viewing and inspecting diagnostic 
problem --solving behavior. The most important principles learned from this effort are as 
follows: 

• Providing multiple views of the same knowledge or behavior can help a user 
understand a complex system. Tables* trees, pictures, animation, and other graphic 
formats can offer these different views. The current prototype of GUIDON- 
WATCH has made extensive use of trees and tables to display information in 
multiple, meaningful ways. Hierarchical relationships are naturally represented as 
trees, and lists of records with several fields are displayed as tables effectively. 
There are several important events in NEOMYCIN such as changes in the 
differential, conclusions about findings and hypotheses, and the task calls. Several 
windows with different fonna^i can provide dii ^'■ent views of these events. 
However, different classes of users may vary with regard to what constitutes an 
effective user interface. 

• The use of bold fonts, boxing and graying items, and other graphic techniques can 
maximize information content and highlight facts and events in a way that is quickly 
understandable. The use of these simple techniques in the Taxonomy and Evidence 
windows illustrates their effectiveness (Figures 4-7 and 4-8). 

• in well-constrained situations it is possible to manage the display and placement of 
windows automatically. Screen spac^. is a precious resource, and each window must be 
designed, sized and placed to use space efficiently. However, this is a job that can 
be cumbersome for a user. Additionally, we want to avoid having a user concentrate 
on the motor activity of using the mouse to movC and place windcivs on the screen. 
We believe that there is a fundamental difference between fhe information retrieval 
task that GUIIX)N-WATCH is designed for and more creative and open-ended 
tasks such as programming or writing. For the latter category, the availability of 
overlapping windows that are usually shaped and positioned under the user's control 
may be more desirable. 
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By displaying information in multiple ways and allowing a user to interactively browse the 
dynamic state of a consultation, we have taken a first step towards reifying the process of 
reasoning d'iring a NEOAflYaN consultation. Subsequent instructional programs now under 
development will ask students to explain, debug, and augment their own and program -generated 
problem-solving behavior. They will use graphic displays like GUIDON-WATCH to compare 
and contrast alternative solutions to problems. 
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